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Abstract 

That there exist two losing games that can be combined, either by 
random mixture or by nonrandom alternation, to form a winning game is 
known as Parrondo's paradox. We establish a strong law of large numbers 
and a central limit theorem for the Parrondo player's sequence of prof- 
its, both in a one-parameter family of capital-dependent games and in 
a two-parameter family of history-dependent games, with the potentially 
winning game being either a random mixture or a nonrandom pattern of 
the two losing games. We derive formulas for the mean and variance pa- 
rameters of the central limit theorem in nearly all such scenarios; formulas 
for the mean permit an analysis of when the Parrondo effect is present. 
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1 Introduction 



The original Parrondo (1996) games can be described as follows: Let p := | — e 
and 

1 3 m 

Vo-=r^-e, pi :=--£, (1) 

where e > is a small bias parameter (less than 1/10, of course). In game A, 
the player tosses a p-coin (i.e., p is the probability of heads). In game B, if the 
player's current capital is divisible by 3, he tosses a po-coin, otherwise he tosses 
a pi-coin. (Assume initial capital is for simplicity.) In both games, the player 
wins one unit with heads and loses one unit with tails. 

It can be shown that games A and B are both losing games, regardless of 
e, whereas the random mixture C := ^A + ^B (toss a fair coin to determine 
which game to play) is a winning game for e sufficiently small. Furthermore, 
certain nonrandom patterns, including AAB, ABB, and AABB but excluding 
AB, are winning as well, again for e sufficiently small. These are examples of 
Parrondo 's paradox. 

The terms "losing" and "winning" are meant in an asymptotic sense. More 
precisely, assume that the game (or mixture or pattern of games) is repeated 
ad infinitum. Let S n be the player's cumulative profit after n games for n > 1. 
A game (or mixture or pattern of games) is losing if lim,!-^ S n = — oo a.s., 
it is winning if linin^oo S n = oo a.s., and it is fair if — oo = liminfn^oo S n < 
lim sup^^^ S n = oo a.s. These definitions are due in this context to Key, 
Klosek, and Abbott (2006). 

Because the games were introduced to help explain the so-called flashing 
Brownian ratchet (Ajdari and Prost 1992), much of the work on this topic has 
appeared in the physics literature. Survey articles include Harmer and Abbott 
(2002), Parrondo and Dims (2004), Epstein (2007), and Abbott (2009). 

Game B can be described as capital- dependent because the coin choice de- 
pends on current capital. An alternative game B, called history- dependent, was 
introduced by Parrondo, Harmer, and Abbott (2000): Let 

9 17 

Po:=Y7j- £ ' Pi = := ^ - £, Ps ■= ^ - £, (2) 

where e > is a small bias parameter. Game A is as before. In game B, the 
player tosses a po _ coin (resp., a pi-coin, a p2-coin, a p3-coin) if his two previous 
results are loss-loss (resp., loss- win, win- loss, win- win). He wins one unit with 
heads and loses one unit with tails. 

The conclusions for the history-dependent games are the same as for the 
capital-dependent ones, except that the pattern AB need not be excluded. 

Pyke (2003) proved a strong law of large numbers for the Parrondo player's 
sequence of profits in the capital-dependent setting. In the present paper we 
generalize his result and obtain a central limit theorem as well. We formulate 
a stochastic model general enough to include both the capital-dependent and 
the history-dependent games. We also treat separately the case in which the 
potentially winning game is a random mixture of the two losing games (game A 
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is played with probability 7, and game B is played with probability 1 — 7) and 
the case in which the potentially winning game (or, more precisely, pattern of 
games) is a nonrandom pattern of the two losing games, specifically the pattern 
[r,s], denoting r plays of game A followed by s plays of game B. Finally, we 
replace (1) by 

P 2 1 
where p > 0; (1) is the special case p — 1/3. We also replace (2) by 



1 A A 

Po ■= — e, Pi =P2 ■= z , r -g, P3~l- 



1 + K ' " r ' 1 + A ' r " 1 + K 

where n > 0, A > 0, and A < 1 + k; (2) is the special case k = 1/9 and A = 1/3. 
The reasons for these parametrizations are explained in Sections 3 and 4. 

Section 2 formulates our model and derives an SLLN and a CLT. Section 3 
specializes to the capital-dependent games and their random mixtures, showing 
that the Parrondo effect is present whenever p £ (0, 1) and 7 € (0, 1). Section 4 
specializes to the history-dependent games and their random mixtures, showing 
that the Parrondo effect is present whenever either K<A<lorK>A>l 
and 7 e (0, 1). Section 5 treats the nonrandom patterns [r,s] and derives an 
SLLN and a CLT. Section 6 specializes to the capital-dependent games, showing 
that the Parrondo effect is present whenever p £ (0, 1) and r, s > 1 with one 
exception: r = s = 1. Section 7 specializes to the history-dependent games. 
Here we expect that the Parrondo effect is present whenever either k < A < 1 
or k > A > 1 and r, s > 1 (without exception) , but although we can prove it 
for certain specific values of k and A (such as n = 1/9 and A = 1/3), we cannot 
prove it in general. Finally, Section 8 addresses the question of why Parrondo's 
paradox holds. 

In nearly all cases we obtain formulas for the mean and variance parame- 
ters of the CLT. These parameters can be interpreted as the asymptotic mean 
per game played and the asymptotic variance per game played of the player's 
cumulative profit. Of course, the pattern [r, s] comprises r + s games. 

Some of the algebra required in what follows is rather formidable, so we have 
used Mathematica 6 where necessary. Our .nb files are available upon request. 



2 A general formulation of Parrondo's games 

In some formulations of Parrondo's games, the player's cumulative profit S n 
after n games is described by some type of random walk {S l ra }n>i, and then 
a Markov chain {X n } n >o is defined in terms of {S'n}n>i; for example, X n = 
t;o + S n (mod 3) in the capital-dependent games, where £0 denotes initial capital. 
However, it is more logical to introduce the Markov chain {X n } n > first and 
then define the random walk {S' Il }„>i in terms of {X n } n > n . 

Consider an irreducible aperiodic Markov chain {X n }n>o with finite state 
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space E. It evolves according to the one-step transition matrix 1 P = (Py)^-^. 
Let us denote its unique stationary distribution by 7r = (7rj)j 6 £. Let w : ExSh 
R be an arbitrary function, which we will sometimes write as a matrix W := 
(w(i,j))ij£-£ and refer to as the payoff matrix. Finally, define the sequences 
{6Jn>i and {S n } n >i by 



£„ := w(X n -i,X n ), n>l, 



and 
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n > 1. 



(3) 



(4) 



For example, let £ := {0, 1, 2}, put X$ := £o (mod 3), £o being initial capital, 
and let the payoff matrix be given by 2 



W := 




(5) 



With the role of P played by 

po 1-po 
1-pi pi 
Pi 1-pi 

where po and p\ are as in (f ), S n represents the player's profit after n games 
when playing the capital-dependent game B repeatedly. With the role of P 
played by 

/ p l-p 
P A := 1 - p p 
\ p l-p 

where p := \ — e, S n represents the player's profit after n games when playing 
game A repeatedly. Finally, with the role of P played by Pc ■= 7-Pa + (1— i)Pb, 
where < 7 < 1, S n represents the player's profit after n games when playing 
the mixed game C := + (f — ~f)B repeatedly. In summary, all three capital- 
dependent games are described by the same stochastic model with a suitable 
choice of parameters. 

Similarly, the history-dependent games fit into the same framework, as do 
the "primary" Parrondo games of Cleuren and Van den Broeck (2004). 

Thus, our initial goal is to analyze the asymptotic behavior of S n under 
the conditions of the second paragraph of this section. We begin by assuming 
that Xq has distribution 7r, so that {X n } n >o and hence {£ n }n>i are stationary 
sequences, although we will weaken this assumption later. 



1 In the physics literature the one-step transition matrix is often written in transposed form, 
that is, with column sums equal to 1. We do not follow that convention here. More precisely, 
here Py := P{X n = j | X„_i = i). 

2 Coincidentally, this is the payoff matrix for the classic game stone-scissors-paper. How- 
ever, Parrondo's games, as originally formulated, are games of chance, not games of strategy, 
and so are outside the purview of game theory (in the sense of von Neumann). 
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We claim that the conditions of the stationary, strong mixing central limit 
theorem apply to {£, n }n>i- To say that {£ n }n>i has the strong mixing property 
(or is strongly mixing) means that a(n) — > as n — > oo, where 

a(n):=sup sup \P(E D F) - P(E)P(F)\. 

m B6 < 7(ei,...,£ TO ),Fe<T(£ TO +»,em+«+i,-) 

A version of the theorem for bounded sequences (Bradley 2007, Theorem 10.3) 
suffices here. That version requires that X)n>i a ( n ) < 00 • our setting, 
{^n}n>o is strongly mixing with a geometric rate (Billingsley 1995, Example 
27.6), hence so is {£, n }n>i- Since £i,£;2, ■ ■ ■ are bounded by max|iu|, it follows 
that 

oo 

a 2 := Var(£i) + 2 £ Cov(£i,£m+i) 

m— 1 

converges absolutely. For the theorem to apply, it suffices to assume that a 2 > 0. 

Let us evaluate the mean and variance parameters of the central limit theo- 
rem. First, 

H := E[£i] = ^P(^o = i)'E[w(Xo,X 1 ) \X =i] ^-/^ ; , /•;/..;; (6) 

i i,j 

and 

Var(a) = E[£ 2 ] - (E[£i]) 2 = ^ Tr^-^i, j) 2 - (j^^Mhj) 
To evaluate Cov(£i,£ m +i), we first find 

E[a6«+i] = ^2ir i E[w(x ,Xi)E[w(x m ,x m+1 ) I Xo.Xx] | x = i] 

i 

= TTiPijwji, j)E[w(X m , X m+ i) | X a = j] 

= nPiMhNP^jkPkMkJ), 

i,j,k,l 

from which it follows that 

Cov(a,u+i)= ^PiMhMP^jk-^PkMkj). 

i,j,k,l 

We conclude that 

oo 

^ Cov(£l,£ m+ l) = ^ TTiP i: jW(i,j)(z jk -Tr k )Pkiw(k,l), 
m=l i,j,k,l 

where 2 = is the fundamental matrix associated with P (Kemeny and 

Snell 1960, p. 75). 
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In more detail, we let II denote the square matrix each of whose rows is 7r, 
and we find that 

oo oo 

J2 GP m_1 - n) = J — n + X!( p ' 1 n) = z n, 

where 

oo 

Z:=/ + ^(P"-n) = (/-(p-n))- 1 ; (7) 

71=1 

for the last equality, see Kemeny and Sncll (loc. cit.). Therefore, 
a 2 -/',,//•;'../ i 2 - {Y^nPijw{i,j)J 

+ 2 ^ KiPijw(i,j)(zj k - ir k )Pkiw{k,l). (8) 

i,j,k,l 

A referee has pointed out that these formulas can be written more concisely 
using matrix notation. Denote by P' (resp., P") the matrix whose (i,j)th 
entry is Pijw(i,j) (resp., Pijiv(i, j) 2 ), and let 1 := (1, 1, . . . , 1) T . Then 

^ = 7rP'l and a 2 = ttP"1 - (ttP'1) 2 + 2ttP'(Z - II)P'l. (9) 

If a 2 > 0, then (Bradley 2007, Proposition 8.3) 

lim n" 1 Var(S' n ) = a 2 



and the central limit theorem applies, that is, (S n — rip) / V na 2 — >d N(0, 1). If 
we strengthen the assumption that X)n>i a ( n ) < oo by assuming that a(n) = 
0(n _(1+l5 )), where < 5 < 1, we have (Bradley 2007, proof of Lemma 10.4) 

E[(S„ - npf] - 0(n 3 ~ s ), 

hence by the Borel-Cantelli lemma it follows that S n /n — > /i a.s. In other words, 
the strong law of large numbers applies. 

Finally, we claim that, if \i = and a 2 > 0, then 

— oo = liminf S n < lim sup S n = oo a.s. (10) 

n * oo n — >00 

Indeed, {£ n }n>i is stationary and strongly mixing, hence its future tail cr-field 
is trivial (Bradley 2007, p. 60), in the sense that every event has probability 
or 1. It follows that P(liminf„^ oc S n = — oo) is or 1. Since fi = and a 2 > 0, 
we can invoke the central limit theorem to conclude that this probability is 1. 
Similarly, we get P(limsup JWOO S„ = oo) = 1. 

Each of these derivations required that the sequence {£ n } r i>i be stationary, 
an assumption that holds if Xq has distribution 77, but in fact the distribution 
of Xq can be arbitrary, and {£n}n>i need not be stationary. 
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Theorem 1. Let fi and a 2 be as in (6) and (8). Under the assumptions of the 
second paragraph of this section, but with the distribution of Xq arbitrary, 

S 

lim n _1 E[S'„] = /i and — — > /i a.s. (11) 

n — *oo Ti 

and, if a 2 > , 

Q 

lim n- 1 Var(S*„) = cr 2 and " ZHf -+ d N(0, 1). (12) 

n^oo \Jn0 2 

If \i = and a 2 > 0, then (10) holds. 

Remark. Assume that a 2 > 0. It follows that, if S n is the player's cumulative 
profit after n games for each n > 1, then the game (or mixture or pattern of 
games) is losing if \i < 0, winning if /x > 0, and fair if fx = 0. (See Section 1 for 
the definitions of these three terms.) 

Proof. It will suffice to treat the case Xo = io £ E, and then use this case to 
prove the general case. Let {X n } n >o be a Markov chain in E with one-step 
transition matrix P and initial distribution 7r, so that {£ n } n >i is stationary, as 
above. Let N := min{n > : X n — io}, and define 

X n := XN +n , n > 0. 

Then {X n } n >o is a Markov chain in E with one-step transition matrix P and 
initial state Xo = io- We can define {£, n }n>i and {S n } n >i in terms of it by 
analogy with (3) and (4). If n > N, then 

S n - S„ = |i + • • • + i n - ^ + • • • + £„) 

= Cl + ' ' ' + Cn-N + Cn-JV+1 H + Cn 

- (6 + "--+CiV+eJV+l + ---+Cn) 
= H h - (£l H 1- Civ), 

and S n — S n is bounded by 2iVmax \ w\. Thus, if we divide by n or V na 2 , the 
result tends to a.s. as n — > oo. We get the SLLN and the CLT with S n in place 
of SVi, via this coupling of the two sequences. We also get the last conclusion in 
a similar way. The first equation in (11) follows from the second using bounded 
convergence. Finally, the random variable N has finite moments (Durrett 1996, 
Chapter 5, Exercise 2.5). The first equation in (12) therefore follows from our 
coupling. □ 

A well-known (Bradley 2007, pp. 36-37) nontrivial example for which a 2 = 
is the case in which E C R and w(i,j) = j—i for alH, j € E. Then S„ = X n — Xq 
(a telescoping sum) for all n > 1, hence /z = and a 2 = by Theorem 1. 

However, it may be of interest to confirm these conclusions using only the 
mean, variance, and covariance formulas above. We calculate 

jti := E[£i] = Ki p ij U ~ i) = X] ~ %ii = °' 
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Var(6) = KiPiM - *) 2 - ^ = 2 ]T ^ - 2 £ (13) 

id i id 

and 

oo 

X! Cov (6)Cm+l) = Yl 7r « P «0' _ i)Z]kPkl{l - k) 
m=l 

= ^ KiPijZjkPkljl - 2J TTiPljZjkPkljk 
i,j,k,l i,j,k,l 

- ^ KiPijZjkPuil + ^2 KiPijZjkPuik 

i,j.k.l i,j,k,l 

= ^2 ^jZjkPkljl ~ ^ ITjZjkjk 
j,k,l j,k 

- ^2 -,/',,:, ,>/'/./// • ^ -,/',,. :,,,//,•. (14) 

i,j,k,l ijjyk 

Since Z = (J - (P - n)) -1 , we can multiply (I — P + H)Z = I on the right by 
P and use UZP = UP = II to get PZP = ZP + 11 P. This implies that 

PkiU + 51 

7Tj7r ; iZ - y^^WjPiiil. 

i,j,k,l i,k,l i,l i,l 

From the fact that PZ = Z + U — J, we also obtain 



KiPijZjkik = ^2 KiZikik + ^2 KiKhik - y^7r, 

£,fc £,fc i 

Substituting in (14) gives 

oo 

cov(^i,<^ m+ i) = y^wiPuu - y^7r 

m— 1 z,/ 

and this, together with (13), implies that a 2 = 0. 



^ 2 , 



3 Mixtures of capital-dependent games 

The Markov chain underlying the capital-dependent Parrondo games has state 
space X = {0, 1, 2} and one-step transition matrix of the form 

/ p 1 - po \ 
P = \ 1-Pi Pl , (15) 

V P2 1 - P2 / 

where Po,Pi,P2 € (0, 1). It is irreducible and aperiodic. The payoff matrix W 
is as in (5). 



It will be convenient below to define qi :— 1 — pi for i = 0, 1, 2. Now, the 
unique stationary distribution n = (ttq, 7Ti, it?) has the form 



7ro = (l-p 1 q 2 )/d, 7Ti = (1 -P2qa)/d, 7T 2 = (1 - p qi)/d, 

where d := 2 + PqPiP2 + qoQiQ2- Further, the fundamental matrix .Z = (zj?) is 
easy to evaluate (e.g., z 00 = 7r + [7Ti(l +pi) + 7r 2 (l + 92)]/^)- 
We conclude that {£„}„>! satisfies the SLLN with 

2 

A* = ^2Mp< - Qi) 

i=Q 

and the CLT with the same p. and with 
2 2 

<7 2 = 1 - M 2 +2^^Vi[pi(z[ i+1]jfe - 7T fc ) - ^(z^-i]^. - Tr k )](pk -qk), 

i=0 fc=o 

where [j] e {0, 1, 2} satisfies j = [j] (mod 3), at least if a 2 > 0. 

Wc now apply these results to the capital-dependent Parrondo games. Al- 
though actually much simpler, game A fits into this framework with one-step 
transition matrix Pa defined by (15) with 

1 

Pa = Pi = P2 ■= - ~ £, 

where e > is a small bias parameter. In game B, it is typically assumed that, 
ignoring the bias parameter, the one-step transition matrix Pg is defined by 
(15) with 

Pi = P2 and /i = 0. 

These two constraints determine a one-parameter family of probabilities given 
by 

Pl=P2= 7—/ m =T (16) 
1 + VPo/(l -Po) 

To eliminate the square root, we reparametrize the probabilities in terms of 
p > 0. Restoring the bias parameter, game B has one-step transition matrix 
Pb defined by (15) with 

P 2 1 

Po := 7- — o _£ ' Pi=P2-=— s, (17 

1 + p z 1 + p 

which includes (1) when p = 1/3. Finally, game C := 7 A + (1 — 7)5 is a 
mixture (0 < 7 < 1) of the two games, hence has one-step transition matrix 
Pc '■= "jPa + (1 — t)-Pb, which can also be defined by (15) with 

1 , S P 2 1 / N 1 

Po ■= 7 7, + I 1 - 7J— — 2 _ e ' Pi = P2 := 7 o + l 1 ~ 7)- 



2 v "1 + p 2 ' ^ " '2 v + p 
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Let us denote the mean p, for game A by p^e), to emphasize the game as 
well as its dependence on e. Similarly, we denote the variance a 2 for game A 
by (r\(e). Analogous notation applies to games B and C. We obtain, for game 
A, Pa(e) = ~ 2e and o\{e) = 1 — 4e 2 ; for game B, 

f , 3(l + 2p + 6p 2 + 2p 3 + p 4 ) 2 

MS(£) = ^7— — gTo £ + 0(e ) 



and 



and for game C, 



2(1 + p + p 2 ) 2 



+ p + p z 



M = 3 7 (l- 7 )(2- 7 )(l-p) 3 (l + p) n , , 

MCW 8(1 + p + p 2 ) 2 + 7 (2 - 7 )(1 - p) 2 (l + 4p + p 2 ) + 1 ' 



and 



4(e) = 1 - /i C (0) 2 - 32(1 - 7 ) 2 (1 - P 3 ) 2 [16(l + p + p 2 ) 2 (l + 4p + p 2 ) 

+ 8 7 (1 - p) 2 (l + 4p + p 2 ) 2 + 24 7 2 (1 - pf{l -p-6p 2 -p 3 + p 4 ) 
-7 3 (4- 7 )(l-p) 4 (7+16p+7p 2 )] 

/[8(1 + p + p 2 ) 2 + 7(2 - 7 )(1 - P) 2 (l + 4p + p 2 )] 3 + 0(e). 

One can check that 0^(0) < 1 for all p 7^ 1 and 7 G (0, 1). 

The formula for <r%(0) was found by Percus and Percus (2002) in a different 
form. We prefer the form given here because it tells us immediately that game 
B has smaller variance than game A for each p ^ 1, provided e is sufficiently 
small. With p = 1/3 and e = 1/200, Harmer and Abbott (2002, Fig. 5) inferred 
this from a simulation. 

The formula for pc(0) was obtained by Bcrrcsford and Rockctt (2003) in a 
different form. We prefer the form given here because it makes the following 
conclusion transparent. 

Theorem 2 (Pykc 2003). Let p > and let games A and B be as above but 
with the bias parameter absent. If 7 € (0,1) and C := 7A + (1 — j)B, then 
pc(0) > for all p e (0, 1), pc(0) = for p = 1, and pc(0) < for all p > 1. 

Assuming (17) with e = 0, the condition p < 1 is equivalent to po < 5- 
Clearly, the Parrondo effect appears (with the bias parameter present) if 
and only if pc(0) > 0. A reverse Parrondo effect, in which two winning games 
combine to lose, appears (with a negative bias parameter present) if and only if 
Mo(0) < 0. 

Corollary 3 (Pyke 2003). Let games A and B be as above (with the bias pa- 
rameter present). If p € (0,1) and 7 € (0,1), then there exists Eq > 0, de- 
pending on p and 7, such that Parrondo 's paradox holds for games A, B , and 
C := *fA + (1 — j)B, that is, < 0, /ab(e) < 0, and pc(s) > 0, whenever 

< £ < So- 



li) 



The theorem and corollary are special cases of results of Pyke. In his form- 
ulation, the modulo 3 condition in the definition of game B is replaced by a 
modulo m condition, where m > 3, and game A is replaced by a game analogous 
to game B but with a different parameter po. Pykc's condition is equivalent to 
< p < po < 1. We have assumed m = 3 and po = 1. 

We would like to point out a useful property of game B. We assume e = 
and we temporarily denote {X n } n > , {£„}„>i, and {S n } n >i by {X n (p)} n > , 
{£,n(p)}n>i, and {S n (p)} n >i to emphasize their dependence on p. Similarly, 
we temporarily denote pb(0) and o^(0) by pb(p,0) and a 2 3 (p 7 0). Replacing 
p by 1/p has the effect of changing the win probabilities po = /0 2 /(l + p 2 ) and 
pi = 1/(1 + p) to the loss probabilities 1 — po and 1 — pi, and vice versa. 
Therefore, given p S (0, 1), we expect that 

£n(V/>) = -£n(p), S„{l/p) = -S n (p), 11 > 1, 

a property that is in fact realized by coupling the Markov chains {X n (p)} n >o 
and {X n (l/ p)} n >o so that X n (l/p) = —X n (p) (mod 3) for all n > 1. It follows 
that 

M B (l/p,0) = -Mp,0) and of (1/p, 0) = a|(p, 0). (18) 

The same argument gives (18) for game C. The reader may have noticed that 
the formulas derived above for ^s(O) and o^(0), as well as those for pc(0) and 
o£(0), satisfy (18). 

When p = 1/3, the mean and variance formulas simplify to 

Pb(s)=-—s + 0(s 2 ) and o|( £ ) = — + 0(e) 

and, if 7 = 4 as well, 

18 , , 2 . , 311313105 , 

/i C (e) = h O(e) and cr^(e) = h O(e). 

pev ; 70g -r w cv ; 356400829 w 



4 Mixtures of history-dependent games 



The Markov chain underlying the history-dependent Parrondo games has state 
space £ = {0,1,2,3} and one-step transition matrix of the form 



/ 1-po po \ 

1- Pl Pl 

1-P2 P2 

V i-p 3 P3 j 



(19) 



where po,pi,p2,P3 G (0, 1). Think of the states of £ in binary form: 00, 01, 10, 
11. They represent, respectively, loss-loss, loss-win, win-loss, and win-win for 
the results of the two preceding games, with the second-listed result being the 
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more recent one. The Markov chain is irreducible and aperiodic. The payoff 
matrix W is given by 



W 



/-ll \ 
0-11 

-11 
\ 0-11/ 



It will be convenient below to define := 1 — pi for i = 0, 1, 2, 3. Now, the 
unique stationary distribution tv = (jro, 7Ti, 7T2, ^3) has the form 

tto = qiqzld, tt\ = p Q q 3 /d, ir 2 = Paqn/d, 7r 3 = p pi/d, 

where d := poPi + 2po<?3 + 929s ■ Further, the fundamental matrix Z — (zy) can 
be evaluated with some effort (e.g., z oa = ir Q + [7Tx(pi + 2q 3 ) + 7r 2 (piP2 + 2?2<Z3 + 

93) + 7T3(PlP2 +p 2 ?3 + 92 + 

We conclude that {£ n } n >i satisfies the SLLN with 



i=0 

and the CLT with the same fi and with 
3 3 

O 2 = 1 - A f2 + 2 ^ ^ ^i\Pi(z\2i+l],k - Tfc) - ?i(^[2i],fe - ""fc )] (Pfc - Qk), 

where [j] G {0, 1, 2, 3} satisfies j = [j] (mod 4), at least if a 2 > 0. 

We now apply these results to the history-dependent Parrondo games. Al- 
though actually much simpler, game A fits into this framework with one-step 
transition matrix Pa defined by (19) with 



Po = Pi = P2 = P3 



1 

2~ e ' 



where e > is a small bias parameter. In game B, it is typically assumed that, 
ignoring the bias parameter, the one-step transition matrix Pb is defined by 
(19) with 

Pi = Pi and /j = 0. 
These two constraints determine a two-parameter family of probabilities given 

by 

Pi=P2 and p 3 = 1 - . (20) 

1 - Pi 

We reparametrize the probabilities in terms of k > and A > (with A < 1 + n). 
Restoring the bias parameter, game B has one-step transition matrix Pg defined 
by (19) with 



Po := 



1 

1 + K 



£, Pi = P2 



A 

1 + A 



P3 



1 



A 



(21) 
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which includes (2) when k = 1/9 and A = 1/3. Finally, game C := 7v4+(l — ~f)B 
is a mixture (0 < 7 < 1) of the two games, hence has one-step transition matrix 
Pc ■= ^Pa + (1 — i)Pb-, which also has the form (19). 

We obtain, for game A, ha(z) = — 2e and o~ 2 A (e) = 1 — 4e 2 ; for game B, 

(1 + «;)(1 + A) 2x 
Me) = -± g L e + 0(e 2 ) 

and 

and for game C, 

Hc{e) = 7(1 - 7)(1 + «)(* - «)(1 - A)/[2 7 (2 - 7) + 7(5 - 7 )« 

+ (8 - 97 + 3 7 2 )A + 7(1 + 7 )k 2 + 4kA + (1 - 7) (4 - 7 )A 2 
+ 7(1 + 7 )k 2 A + 3 7 (1 - 7 )kA 2 ] + 0(e) 

and 

a 2 c (e) = 1 - A i C (0) 2 + 8(1 - 7) [2 - 7 (1 - k)][2A + 7(1 + « - 2A)] 

• [2A(2 + k + A) 2 (l + 2k - 2A + k 2 - 3A 2 + k 2 A - A 3 + k 2 A 2 ) 
+ 7(2 + k + A) (2 + 5k - 11A + 4k 2 - 16kA + 2A 2 + k 3 

- 3k 2 A - 2kA 2 + 18A 3 + 2k 3 A + 10k 2 A 2 - IOkA 3 + 12A 4 
+ 8k 3 A 2 - 8k 2 A 3 - 13kA 4 + 3A 5 + 2k 3 A 3 - 6k 2 A 4 - 2kA 5 
+ k 3 A 4 + k 2 A 5 ) - 7 2 (6 + 14k - 14A + 9k 2 - 24kA - 9A 2 

- 18k 2 A + 2kA 2 + 16A 3 - k 4 - 12k 3 A + 33k 2 A 2 + 16A 4 

- 4k 4 A + 16k 3 A 2 + 12k 2 A 3 - 30kA 4 + 6A 5 - 9k 2 A 4 - 16kA 5 
+ A 6 - 4k 4 A 3 + 6k 2 A 5 - 2kA 6 - k 4 A 4 + 4k 3 A 5 + 3k 2 A 6 ) 

+ 2 7 3 (1 - kA) 2 (1 + k - A - A 2 ) 2 ] 
I {{I + A)[2 7 (2 - 7) + 7(5 - 7 )k + (8 - 9 7 + 3 7 2 )A + 7(1 + 7 )k 2 

+ 4kA + (1 - 7) (4 - 7 )A 2 + 7(1 + 7 )k 2 A + 3 7 (1 - 7 )kA 2 ] 3 } 
+ 0(e). 

By inspection, we deduce the following conclusion. 

Theorem 4. Let k > 0, A > 0, and A < 1 + k, and let games A and B be as 
above but with the bias parameter absent. J/ 7 G (0, 1) and C := ^A + (1 — j)B, 
then /ic(0) > whenever k<A<1 or k > A > 1, /ic(0) = whenever k = A 
or A = 1, and //c(0) < whenever A < min(K, 1) or A > max(K, 1). 

Assuming (21) with e = 0, the condition k < A < 1 is equivalent to 
Po+Pi>l and Pi=P2<\, 



(1 + k)(1 + k + kA + kA 2 ) 
A(1 + A)(2 + k + A) 



O(e); 
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whereas the condition n > A > 1 is equivalent to 

Po+Pi<l and pi=p 2 >^. 

Again, the Parrondo effect is present if and only if /zc(0) > 0. 

Corollary 5. Let games A and B be as above (with the bias parameter present). 
IfO<K<\<lorK>\>l, and if 7 G (0, 1), then there exists Sq > 0, 
depending on k, X, and 7, such that Parrondo 's paradox holds for games A, 
B, and C := jA + (1 — j)B, that is, ^a{s) < 0, ^b(e) < 0, and yUc(e) > 0, 
whenever < e < Eq. 

When k = 1/9 and A = 1/3, the mean and variance formulas simplify to 

20 235 
Li B {e) = ~—e + 0{e 2 ) and a%{e) = — + 0(e) 

and, if 7 = i as well, 

5 s~\( \ l 2 / \ 25324040 ^. . 

a c (e) = h O(e) and crAfe) = h O(e). 

MGW 429 w cw 26317863 w 

Here, in contrast to the capital-dependent games, the variance of game B is 
greater than that of game A. This conclusion, however, is parameter dependent. 



5 Nonrandom patterns of games 

We also want to consider nonrandom patterns of games of the form A r B s , in 
which game A is played r times, then game B is played s times, where r and s 
are positive integers. Such a pattern is denoted in the literature by [r, s]. 

Associated with the games are one-step transition matrices for Markov chains 
in a finite state space E, which we will denote by Pa and Pb, and a function 
i« : S x S ^ R. We assume that Pa and Pb are irreducible and aperiodic, 
as are P := P r A P s B , P^P^Pa, P S B P^ PeP^ 1 (^c r + s cyclic 
permutations of P^Pg). Let us denote the unique stationary distribution asso- 
ciated with P by 7r = (jTi)i^s. The driving Markov chain {X n } n >o is time- 
inhomogeneous, with one-step transition matrices Pa, Pa, ■ ■ ■ , Pa {t times), 
P B , Pb, ■ ■ ■ , (s times), Pa, Pa, ■ ■ ■ , Pa (r times), P b ,Pb, ■ ■ ■ , Pb (s times), 
and so on. Now define {£„}„>i and {S„} n >i by (3) and (4). What is the 
asymptotic behavior of S n as n ► 00? 

Let us give Xq distribution tt, at least for now. The time-inhomogeneous 
Markov chain {X n } n > is of course not stationary, so we define the (time- 
homogeneous) Markov chain {X n } n > by 

Xi := (Xq, X\, . . . , X r+S ), 

X2 '■= (X r+S , X r+s+ i, . . . , X 2 ( r+S )), (22) 

X3 := (X 2 ( r +s), X 2 ( r +s) + l, ■ ■ ■ , X 3 ( r+s -f), 
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and we note that this is a stationary Markov chain in a subset of £ r +s+i_ 
(The overlap between successive vectors is intentional.) Wc assume that it is 
irreducible and aperiodic in that subset, hence it is strongly mixing. Therefore, 

(6.) ■ ■ ■ ,£r+s)j (£r+s+i, ■ ■ ■ ,&(r+s)), (6(r+s)+ij ■ ■ ■ ,6(r+ s )), ■ ■ ■ is itself a station- 
ary, strongly mixing sequence, and we can apply the stationary, strong mixing 
CLT to the sequence 

Vl : =fH Kr+a, 

m ■■= Cr+s+1 H r-6(r+s)) ( 23 ) 

V3 ■= C2(r+s) + l H |-£3(r+s), 



We denote by jl and a 2 the mean and variance parameters for this sequence. 

The mean and variance parameters /i and a 2 for the original sequence 
£1, • • • can be obtained from these. Indeed, 

/i:= lim E[S( r+a ) n ] = lim - — J—— E[rn H h ??„] = — 7—, 

?i^oo (7- + s)n n— too (r + s)n r + s 

where fi := E[?ji], and 

(T 2 := lim - — ■ — r- Var(5( r+S )„) = lim - — ■ — —Vax(r]i H h ??„) = — , 

n— >oo (r + sjn n->oo (r + sjn r + s 

where 

00 

<T 2 := Var(7?i) + 2 ^ Cov(t/i, r) m+ i). 

m— 1 

It remains to evaluate these variances and covariances. 
First, 

^ u— i,j v—0 i,j 

, (24) 

This formula for fi is equivalent to one found by Kay and Johnson (2003) in the 
history-dependent setting. 
Next, 

Var(7?i) 

r — 1 S—1 

= ^ Var(£ u+1 ) + J2 Var(£ r+1 , + i) + 2 ^ Cov(&+i, 

u=0 v=0 0<u<v<r—l 

r—1 s — 1 

+ 2 y] y] Cov(£ M+ i, gr+^+l) + 2 2J Cov(^ r+u+ i, f r +u+l) 

11=0 D=0 0<U<U<S— 1 
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r-l r , 

u—0 i.j i,j 

+ 2 E J2^ P Ah( P AhMhj) 

" " -[(PT u - 1 )j k -^Pl)h]{PA)kMk,i) 

r-l s-1 



+ 2 E £ (^^m^Mm) 

o<u<v<s-nj. k .i [{ pv-u-i )jk _ i7V pr A pv )k]{ p B)klw{kjl y (25) 

Furthermore, 
Cov(r/i,r/ m+ i) 

= Cov(£i H h£r+s,£m(r+s) + l H h £( m +l)( r +*)) 

r— 1 r— 1 r— 1 s— 1 



cov(^ M+ i, ^ m ( r+s ) +1)+1 ) + cov(^ u -i_i,^ m ( r _i_ S ) +r _i_„_i_i) 

u=0 t;=0 it=0 l>=0 

s — 1 r — 1 s — Is — 1 

) + E E cov(^ r+u+ i,? m(r+s)+r+v+1 ) 



M= v=0 
} — 1 r — 1 



EEEwww^') 



«_0„-0i,i,W _ [(pr—lp-pm-lp^ _ ( ff pjJ) fc ](p A ) wU ,( M ) 



r— 1 5 — 1 



«=0.=0^ fe)i _ [( pr-«-lp|pm-lprpg )jfc _ ( w prpg) fc ](p fl ) jU „,(A !j Z) 
s-1 r-l 

+ EE E (^MM^iMU) 
„=o*=om,m [(p ,_ u _ lpm _ lpi) _ fc _ (7rP . )fe]( p A)feiw(fcj0 

s-1 s-1 

+ EE E (^^m^Mm) 

■« [(p ,_«-i pro -i plpl) . fc _ {n pr A pv )k]{ p B)klw{k jy 



Consider the factor (P^- 1 P B P m - x P^) jk - {TvP'X) k in the first sum on the 
right, for example. With II denoting the square matrix each of whose rows is 
7r, we can rewrite this as 

/nr-u-lns nm-lntii f nr — u—1 ns rr p»\ 
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[P r A -«- x P s B {P™- x -U)Pl\ jk 



Thus, summing over m > 1, we get 

oo 

,r)m+i) 



m—1 

r—1 r—1 



= EE E^mp^^) 

" =09=ow,w ■ [Pl- u - 1 P5(^-n)PX] ifc (PA)«t«(fc J 

r—1 s— 1 

„=o„=oij,*,i [Pr -ip |(z _n)PiP^(p B ) fciW (fc,o 

s-l s-1 

+ EE E (^J , B)i(ft)««'(i ) i) 

„=o»=Oij, W l[J x-t.-i (z _ II )PJ[Pg] Jfc (P B ) fcl ti;(* J ) (26) 
where .Z is the fundamental matrix associated with P := P^P^. We conclude 



that 



a 2 



J- (Var(r/i) + 2 E Covfai, Wi)) , (27) 



which relies on (25) and (26). 

We summarize the results of this section in the following theorem. 

Theorem 6. Let /i and a 2 be as in (24) and (27). Under the assumptions of 
the second paragraph of this section, but with the distribution of Xq arbitrary, 

lim n _1 E[«SVi] = /i and — — » /j a.s. 

n — >oo 77, 

and, i/ cr > , 

lim n^VaxiSn) = o 2 and ° n jv(0, 1). 



If fj, = and a 2 > 0, i/ierc (10) holds. 

Remark. It follows that a pattern is losing, winning, or fair according to whether 
H < 0, fi > 0, or fx = 0. 

Proof. The proof is similar to that of Theorem 1, except that N := min{n > 
: X n = io, n is divisible by r + s}. □ 
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In the examples to which we will be applying the above mean and variance 
formulas, additional simplifications will occur because Pa has a particularly 
simple form and Pb has a spectral representation. Denote by P' A the matrix 
with (i,j)th entry (PA)ijw(i, j), and assume that P' A has row sums equal to 
0. Denote by P' B the matrix with (i,j)th entry (P B )ijw(i, j), and define C '■— 
P B (1,1, . . . ,1) T to be the vector of row sums of P' B . Further, let t := |S| 
and suppose that P B has eigenvalues 1, e%, . . . , et-i and corresponding linearly 
independent right eigenvectors t*o, t\, . . . , r t -\. Put D := diag(l, e\, . . . , et-i) 
and R := (t*o,t*i, . . . ,r t _i). Then the rows of L := R 1 are left eigenvectors 
and P V B = RD"L for all v > 0. Finally, with 

D v := diag v, 



1-ei l-e t _i 

we have J + Pg + • • • + P B ~ = RD V L for all v > 1. Additional notation 
includes n s r for the unique stationary distribution of P B P A , and 7r as before 
for the unique stationary distribution of P := P A P B . Notice that itP r A = 7r vr . 
Finally, we assume as well that w(i,j) = ±1 whenever {PA)ij > or (P B )ij > 0. 
These assumptions allow us to write (24) as 

/i = (r + s^tv^RDsLC, (28) 

and similarly (25) and (26) become 

s— 1 r— 1 



Var(Th) = r + s - ^(7r s , r P^C) 2 + 2 £ TvP%P A P r A u l RD s L{ (29) 

S — It! — 1 S — 1 

+ 2 E E ^s,-P^P b Pb~ U ^C -2Y / (*s, r RD v LC)(n s ,.P B -C), 

v—1 u—0 v—1 

and 

cxd r— 1 

£ Covfa.wi) = 53 TrP^PA^r^^K^ - n)p;pr» SJ LC (30) 

s-1 

+ 53 ■K a , r F£P' B P a B - u -\Z - U)P r A RD s LC 



m— 1 (i— 

s-1 



u=0 



A referee has suggested an alternative approach to the results of this section 
that has certain advantages. Instead of starting with a time-inhomogeneous 
Markov chain in E, we begin with the (time-homogeneous) Markov chain in the 
product space S := {0, 1, . . . , r + s — 1} X S with transition probabilities 



i— > (i + 1 mod r + s, fc) with probability 



(Pa),-* if0<i<r-l, 
(Pb)jTc ifr<i<r + s-l. 
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It is irreducible and periodic with period r + s. Ordering the states of £ lexico- 
graphically, we can write the one-step transition matrix in block form as 








Po 






Pi 








Pr+s-2 





/ 

< 

p 

-1 



i < r ■+ 
is 7r := 
for 1 < 



s — 
(r + 
i < 





V Pr+s-1 

where JP, := Pa for < i < r — 1 and P^ := Pb for r 
1. With 7r as above, the unique stationary distribution for 
s) _1 (7r ,7ri, . . . ,7T r+s _i), where 7T := ir and 7T, := 7ri_iPj 
r + s — 1. Using the idea in (22) and (23), we can deduce the strong mixing- 
property and the central limit theorem. The mean and variance parameters are 
as in (9) but with bars on the matrices. Of course, Z := (I — (P — II)) , n 
being the square matrix each of whose rows is 7r; P' is as P but with P' A and 
P' B in place of Pa and Pb ; and similarly for P" . 

The principal advantage of this approach is the simplicity of the formulas for 
the mean and variance parameters. Another advantage is that patterns other 
than those of the form [r, s] can be treated just as easily. The only drawback 
is that, in the context of our two models, the matrices are no longer 3 x 3 or 
4x4 but rather 3(r + s) x 3(r + s) and 4(r + s) x 4(r + s). In other words, the 
formulas (28)-(30), although lacking elegance, are more user- friendly. 



6 Patterns of capital-dependent games 

Let games A and B be as in Section 3; see especially (17). Both games are 
losing. In this section we show that, for every p £ (0, 1), and for every pair of 
positive integers r and s except for r = s = 1, the pattern [r,s], which stands 
for r plays of game A followed by s plays of game B, is winning for sufficiently 
small e > 0. Notice that it will suffice to treat the case e = 0. 

We begin by finding a formula for jUr rjS i(0), the asymptotic mean per game 
played of the player's cumulative profit for the pattern [r, s], assuming 6 = 0. 
Recall that Pa is given by (15) with po = p\ = p2 := \, and Pb is given by 
(15) with po := p 2 /(l + p 2 ) and p\ = P2 := 1/(1 + p), where p > 0. First, we 
can prove by induction that 

1 — 2a r a r a r 
P r A =1 a r 1 — 2a r a r | , r > 1, 



where 



i-Hr 



(31) 



Next, with S := y(I + p 2 )(l + 4p + p 2 ), the nonunit eigenvalues of Pb are 

1 (l-p)S 1 (1- P )S 

e i := _ o + tth—, — \T< — i — tT: e 2 - 



2 2(l + p)(l + p2)' z ' 2 2(l + p)(l + p2)' 
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and we define the diagonal matrix D := diag(l, ei, e'z). The corresponding right 
eigenvectors 

/ (l + p)(l-p 2 -S) 
r 1 := 2 + p + 2p 2 + p 3 + pS 

\-(l + 2p + p 2 + 2p 3 -S) t 

( (l + p)(l-p 2 + S) 
r 2 := 2 + p + 2p 2 + p 3 - pS 

\-{l + 2p + p 2 + 2p 3 + S) / 

arc linearly independent for all p > (including p = 1). so we define R :~ 
(r , ri, r 2 ) and L := Rr 1 . 
Then 

P% = RD S L, s > 0, 

which leads to an explicit formula for P^P^, from which we can compute its 
unique stationary distribution left eigenvector corresponding to the 

eigenvalue 1. With 

C := (2p 2 /(l + p 2 ) - 1, 2/(1 + p) - 1, 2/(1 + p) - 1) T , 

we can use (28) to write 

1 _ .. ( 1 -ef 1 -e| 



A*[r, s ](0) = — ; — 7r s , r .Rdiag s, , LC,. 

r + s \ 1 - ei 1 - e 2 / 

Algebraic computations show that this reduces to 

MM (0) = £ r , 8 /A. jS , (32) 

where 

E r;S := 3a r {[2 + (3a r - l)(ef + e* - 2efe 2 : ) - (ef + e s 2 )}(l - p)(l + p)S 
+ a r (e s 2 - ef )[5(1 + p) 2 (\ + p 2 ) - 4p 2 ]}(l - p) 2 

and 

D r , s ■= 4(r + s)[l + (3a r - l)ef][l + (3a r - l)e^](l + p + p 2 ) 2 S. 
This formula will allow us to determine the sign of p[ r ^(0) for all r, s, and p. 

Theorem 7. Lei games A and B be as in Theorem 2 ( with the bias parameter 
absent). For every pair of positive integers r and s except r = s = 1 , /i[ riS ] (0) > 
for all p G (0, 1) ; P[ r .s](Q) = for p = 1, and /Ur r s i(0) < for all p > 1. In 
addition, p\i t x\(Q) = /or a!/ p > 0. 

The last assertion of the theorem was known to Pyke (2003). As before, 
the Parrondo effect appears (with the bias parameter present) if and only if 
/i[ r iS i (0) > 0. A reverse Parrondo effect, in which two winning games combine to 
lose, appears (with a negative bias parameter present) if and only if p\ r ^ s ] (0) < 0. 
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Corollary 8. Let games A and B be as in Corollary 3 (with the bias parameter 
present). For every p G (0, 1), and for every pair of positive integers r and 
s except r = s = 1, there exists Sq > 0, depending on p, r, and s, such that 
Parrondo's paradox holds for games A and B and pattern [r, s], that is, Pa(e) < 
0, /is(e) < 0, and /i[ r s ](e) > 0, whenever < e < eq. 

Proof of theorem. Temporarily denote /X[ r , s ](0) by fJ-[ r , s ](P: 0) to emphasize its 
dependence on p. Then, given p £ (0,1), the same argument that led to (18) 
yields 

M[r,s](VP>°) = -M[ry»](/>,0), T, S > 1. (33) 

(This also follows from (32).) It is therefore enough to treat the case p € (0, 1). 
Notice that 3a r — 1 = — ( — i) r for all r > 1 and e l7 e 2 E (— 1, 0), hence D r s > 
for all integers r,s > 1. To show that /Ltr r , s ](0) > it will suffice to show that 
E r>s > 0, which is equivalent to showing that 

2+(3a r -l)(e;+e5-2e;e5)-(e; + e $) 

, , s s , 5(l + p) 2 (l + p 2 )- V 
+ fl - (e2 " ei) + (34) 

is positive. We will show that, except when r = s = 1, (34) is positive for all 
integers r, s > 1 . 

First we consider the case in which r > 2 and s = 1. Noting that ei+e2 = — 1, 
e 2 - ei = -(1 - p)S/[(l + p)(l + p 2 )], and ei e 2 = 2p 2 /[(l + p) 2 (l + p 2 )], (34) 
becomes 

1\7, 4p 2 \ 1-Hr 5(l + p) 2 (l + p 2 )-4p 2 



2/ V (i + p) 2 (i + p 2 ); 3 (i + p) 2 (i + p 2 ) 

. , _ 1 (, , V \ _ 3 / 4p 2 

8^ (l + p) 2 (l + p 2 )y 8 V (l + p) 2 (l+p 2 ) 
P 2 

(l + p) 2 (l + P 2 ) 

On the other hand, if r = s = 1, the left side of the last equation becomes 



2 V. (i + p) 2 (i + p 2 )y 2V (i + p) 2 (i + p 2 ) 

so M[l,l](°) = °- 

Next we consider the case of r > 2 and s odd, s > 3. Since p € (0, 1), we 
have ei = — j(l — and e 2 = —5(1 + where < x < 1. Therefore, since s 
is odd, 

e5-e; = -[(l + x)'-(l-x)']/2- 

fc=0 v ' 
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1 ( s \„k-i 



2 S ~ 1 \k 

Kk<s; k odd 



X 



>(e 2 -ei)^T E (l 

l<fe<s; fc odd V 

= e 2 -ei, (35) 

where the last identity uses the fact that, when s is odd, the odd-numbered 
binomial coefficients (*) i (3) j • • • > (j are equal to the even- numbered ones ( s _!i) , 
( s l 3 ), . . . , (g), hence the sum of the odd-numbered ones is 2 S ~ 1 . 
It follows that, since the case r = 1 is excluded, 

2 + (3a r - \){e\ + - 2e?eg) - (e? + 

5(l + p) 2 (l + p 2 )- V 



+ a r (e 2 : - ef)- 



(l-p)(l + p)S 



^ 1, , 9 v,3 5(l + p) 2 (l + p 2 )- V 

> 2 + -(ei + e 2 - 2eie 2 ) + -(e 2 - e x )- 



8 V iy 8 V ly (l-p)(l + p)S 

1 ^ , V \ 3 f e V 



sv (i + p) 2 (i + p 2 ); sv (i + p) 2 (i + p 2 ) 



2 

>0. 



(l+p) 2 (l+p 2 ) 

Consider next the case in which r > 1 and s is even. In this case, the 
last term in (34) is positive, and the remaining terms are greater than 2 — 
(l/4)(5/4) - 5/4 > 0. 

Next we treat the case [1,3] separately. Our formula (32) gives A*[i,3](0) = 
3p 2 (l - p) 3 (l + p)(l + 2p + 2p 3 + p 4 )/[4(l + 6p + 24p 2 + 62p 3 + lllp 4 + 156p 5 + 
180p 6 + 156p 7 + lllp 8 + 62p 9 + 24p 10 + 6p n + p 12 )], which is positive since 
pe (0,1). 

It remains to consider the case of r = 1 and s odd, s > 5. We must show 
that 

2 - 1 (e» + e s + 2eV) + 1 (e s - cn 5(1 + p) 2 (l + p 2 ) - 4p 2 

2 2 (e 1 + e2 + 2 ei e 2 )+ 2 (e 2 ej (1 _ p)(1+p)j g > °- 

Here the inequality of (35) is too crude. Again, we have e\ = — ^(1 — x) and 
e 2 = -|(1 + x), where x = (1 - p)S/[(l + p)(l + p 2 )] € (0,1), so we can 
replace (1 — p)S by x(l + p)(l + p 2 ). We can eliminate the — 4p 2 term in the 
fraction, and we can replace the 2efe| term by — 2ef; in the first case we are 
eliminating a positive contribution, and in the second case we are making a 
negative contribution more negative. Thus, it will suffice to prove that 

2 S + 2 + [(1 + x) s - (1 - x) s ] - [(1 + x) s - (1 - x) s ](5/x) > 

for < x < 1, or equivalently that 

fi x ) '■= t, \ t, r" > 5 — x 

J w (1 + x) s - (1 - x) s 
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for < x < 1. Now [(1 + x) s — (1 — x) s ]/x is a polynomial of degree s — 1 with 
nonnegative coefficients, so / is decreasing on (0, 1) with /(0+) = 2 s+1 /s and 
/(1-) = 4. Further, f{\) = 2 s+1 /[(3/2) ;i -(l/2) s ] > 2 s+1 /(3/2) s = 2(4/3) s > 5 
for ,s > 5. Thus, our inequality f(x) > 5 — x holds for < x < h. It remains to 
confirm it for | < x < 1. On that interval we claim that f(x) +x is decreasing, 
and it clearly approaches 5 as x — > 1 — . Thus, it remains to show that /'(a;) < — 1 
for i < x < 1. We compute 



/'(*) 

< 2 



,+2 K 1 + ~ (1 ~ x) s ] - sx[(l + x)*- 1 + (1 - x) s 



,(1 +x) s - sx(l 
[(l + a;) s - (1 - x) s ] 



2 



< 



< 



2S+2 [(s -!)*-!] + 

[(1 + x) s - (1 - x) s } 2 
1 [4(l/2)-l](l + xr 1 
{l + x) s - (1 -x) s 
(l + ^) s 



(1 + s) s - (1 - x) s 
<-2, 

as required. □ 
Here are four of the simplest cases: 

M[i,x]( £ ) = am T T 2N2 e + 0(e ), 

4(1 + p + /9 Z ) Z 



, = (l-p) 3 (l + /0 )(l + 2p + p 2 + 2p 3 + p 4 ) 

M[i,2] { ) i^ l2p + 20p2 + 28p 3 + 36p 4 + 28p 5 + 2Qp$ + 12p 7 + 3p 8 1 h 



(1 - p) 3 (l +p) 
M[2 ' ll(£) - 10 + 20p+2V + 20p 3 + 10p 4 + (£) ' 

3(1 -p) 3 (l +p) 
^ {£) = 8(3 + 6p+7p 2 + 6p 3 + 3p 4 ) + ° (£) - 

We turn finally to the evaluation of the asymptotic variance per game played 
of the player's cumulative profit. We denote this variance by &f rs i(£), and wc 
note that it suffices to assume that e = to obtain the formula up to 0(e). 

A formula for ah. g , (0) analogous to (32) would be extremely complicated. 
Wc therefore consider the matrix formulas of Section 5 to be in final form. 

Temporarily denote <7p r s j (0) by a^ r s i (p, 0) to emphasize its dependence on 
p. Then, given p G (0, 1), the argument that led to (33) yields 

°[r,e] (VPi °) = °fr, S ] (/>> °): T, S > 1. 

For example, we have 
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ofi.2] ( £ ) = 3 ( 8 + 104 P + 606 P 2 + 2220p 3 + 6189p 4 + 14524p 5 + 29390p 6 
+ 51904/ + 81698p 8 + 115568p 9 + 147156p 10 + 169968p n 
+ 178506p 12 + 169968p 13 + 147156p 14 + 115568p 15 + 81698p 16 
+ 51904p 17 + 29390p 18 + 14524p 19 + 6189p 20 + 2220p 21 
+ 606p 22 + 104p 23 + 8p 24 ) 
/(3 + Yip + 20p 2 + 28/ + 36p 4 + 28p 5 + 20p 6 + 12p 7 + 3p 8 ) 3 
+ 0(e), 

<jf 21] (e) = 3(414 + 2372p + 6757p 2 + 13584p 3 + 21750/ + 28332/ + 30729p 6 
+ 28332/ + 21750/ + 13584/ + 6757/° + 2372/ 1 + 414/ 2 ) 
/(10 + 20p + 21/ + 20/ + 10/) 3 + 0(e), 
<?[2,2] ( £ ) = 9 ( 25 + 288p+ 1396p 2 + 4400p 3 + 10385p 4 + 19452p 5 + 29860/ 
+ 38364/ + 41660/ + 38364/ + 29860/° + 19452/ 1 
+ 10385p 12 + 4400p 13 + 1396p 14 + 288p 15 + 25p 16 ) 
/[16(1 + p + p 2 ) 2 (3 + 6p + 7p 2 + 6p 3 + 3p 4 ) 3 ] + 0(e). 

As functions of p e (0, 1), crX ^ (0), ah 2 , (0), and er 2 2 2 , (0) are increasing, whereas 
cr? 2 ± J0) is decreasing. All approach 1 as p — > 1 — . Their limits as p — > 0+ arc 
respectively 0, 8/9, 25/48, and 621/500. 
It should be explicitly noted that 



for all p > 0. Since these identities may be counterintuitive, let us derive 
them in greater detail. We temporarily denote the stationary distributions and 
fundamental matrices of Pb, PaPb, and PbPa, with subscripts B, AB, and 
BA, respectively. Then 



M[i,i](0) = Ms(0) and cr 2 -. 



ii](0)=4(0) 



(36) 



1 



(1 + p 2 , p(l + p), l + p) 



2(1 + p + /) 



and 



2(1 + p + /) 



(l + p 2 , l + p, p(l + /), 



so 



Mo) 



ttbC = and M[i,i](0) = -ttbaC = 0- 



As for the variances, we recall that 



cr|(0) = 1 + 27tbP b ZbC = 1 + kbP's^ZbC) 



and 



CT +i](°) = 1 + ^abP' a {I + PbZabPaK- 
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But -kabP'a = kbaPbP'a aim 

7rsP ^ = 2(TT7T7) (1 + p ' 

ttbaPbP'a = nn 1 „ P „ 2 \ ( 1 + P> _1 > _ P)> 

-(l + p)(l + 4p + p 2 )' 

= 7T— ^ I 3 + P + P 2 + P 3 
1 + p + p 2 + 3p 3 

-(l + p)(l + 4p + p 2 )' 

(i+p b z ab p a )c= „ ; „,„ I i + p + p^sp 3 





1 - 


P 


2(1 


+ P 


+ P 2 ) 




1 - 


P 


2(1 


+ P 


+ P 2 ) 




1 - 


P 


(n 


-/h 


V) 2 




i - 


P 


(H 


-PH 


-P 2 ) 2 



so it follows that 



4(0) = 4,i](o)= ( r 



3 + p + p 2 + p 3 
3p 



P + P 2 



An interesting special case of (36) is the case p = 0. Technically, we have 
ruled out this case because we want our underlying Markov chain to be irre- 
ducible. Nevertheless, the games are well defined. Assuming Xq = 0, repeated 
play of game B leads to the deterministic sequence 

(S 1 ,S 2 ,S 3 ,...) = (-1,0,-1,0,-1,0,...), 

hence p B (0) = lim n _ >00 n E[iS n ] = and <Jg(0) = linin^oo 7i _1 Var(S', i ) = 0. 
On the other hand, repeated play of pattern AB leads to the random sequence 

{S 1 ,S 2 ,S 3 ,...) = (-1,0,-1,0,...,-1,0,1,2,2±1,2,2±1,2,2±1,...), 

where the number N of initial (—1,0) pairs is the number of losses at game A 
before the first win at game A (in particular, N is nonnegative geometric(i)), 
and the ±1 terms signify independent random variables that are ±1 with prob- 
ability i each and independent of N. Despite the randomness, the sequence is 
bounded, so we still have p[i,i](0) = and ah ^(0) = 0. 

When p = 1/3, the mean and variance formulas simplify to 

228 2\ 9 / \ 81 



M[i,i](e) = -J^ £ + °( £ )> <!] ( £ ) = Y69 + ° {S) 

2416 ^. , 2 , . 14640669052339 

h O(e), of, o, (e) = 

35601 K! [1,2]W 15040606062267 



^ (e) = 3560T + ° (£) ' "I^l (£) = 15040606062267 + ° (e) ' 

32 , 4628172105 ^. . 

MP,H( £ ) = YgQg + O(e), o [2>1] (e) = 41655Q9529 + 0(e), 

4 2 / \ 1923037543 ^, . 

A*p,S|(e) = ^ + O(e), o [2>2] (e) = + O(e). 

Pyke (2003) obtained ^[2,2] (0) ~ 0.0218363 when p = 1/3, but that number is 
inconsistent with Ekhad and Zeilberger's (2000) calculation, confirmed above, 
that /Lt [2 ,2](0) = 4/163 ps 0.0245399. 
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7 Patterns of history-dependent games 



Let games A and B be as in Section 4; see especially (21). Both games are 
losing. In this section we attempt to find conditions on k and A such that, for 
every pair of positive integers r and s, the pattern [r, s], which stands for r plays 
of game A followed by s plays of game B, is winning for sufficiently small e > 0. 
Notice that it will suffice to treat the case e = 0. 

We begin by finding a formula for /Ur r)S ](0), the asymptotic mean per game 
played of the player's cumulative profit for the pattern [r,s], assuming e = 0. 
Recall that Pa is defined by (19) withpo = Pi = P2 = P3 '■= ^, an d Pb is defined 
by (19) with p a := 1/(1 + «), pi = p 2 ■= A/(l + A), and p 3 ;= 1 - A/(l + k), 
where K > 0, A > 0, and A < 1 + k. First, it is clear that P r A = U for all r > 2, 
where U is the 4x4 matrix with all entries equal to 1/4. 

As for the spectral representation of Pb, its eigenvalues include 1 and the 
three roots of the cubic equation a; 3 + a 2 x 2 + a\X + ao = 0, where 

A - k _ (A - k)A(2 + k + A) (1 - kA)(1 + k - A - A 2 ) 

a2:= TT^' ai:_ (1+ K ) 2 (1 + A)2 ' (1 + «)2(1 + A)2 ■ 

(37) 

With the help of Cardano's formula, we find that the nonunit eigenvalues of Pb 
are 



ei 


P + Q 


A - 


K 


3(l + /s)(l + A) 


3(14 


"«)' 


e2 


ojP + uj 2 Q 


A - 


K 


3(l + /c)(l + A) 


3(14 


"«)' 


e3 


w 2 P + wQ 


A - 


K 


3(1 + «)(1 + A) 


3(14 


"«)' 


i 

2 


j- iv3i and w 2 = 


g47ri/3 _ 


: CD = 



where w := e 2 ™/ 3 = — § + §\/3i and w 2 = e 4 ™/ 3 = a; = -§ - ^v^i are cube 
roots of unity, and 



p . = ./ /? + V/3 2 + 4q3 ^ = v //3 2 4-4a 3 



with 



a := (A - «)(« 4- 5A 4- 5kA 4- A 2 4- kA 2 - A 3 ), 

/? := (1 4- A) (27 4- 54k - 27A 4- 27k 2 - 54kA - 27A 2 4- 2k 3 - 42k 2 A 
- 30kA 2 4- 16A 3 - 14k 3 A 4- 6k 2 A 2 4- 30kA 3 + 5A 4 
+ 2k 3 A 2 4- 21k 2 A 3 4- 6kA 4 - 2A 5 ). 

Of course, e\, e 2 , and are each less than 1 in absolute value. 

Notice that the definitions of P and Q are slightly ambiguous, owing to the 
nonuniqueness of the cube roots. (If (P, Q) is replaced in the definitions of 
e±, 62, and by (luP,lo 2 Q) or by (oj 2 P,ojQ). then e±, e 2 , and are merely 
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permuted.) If 1 + 4a 3 > 0, then P and Q can be taken to be real and distinct, 3 
in which case e\ is real and e 2 and are complex conjugates; in particular, ei, 
e 2 , and are distinct. If (i 2 + 4a 3 = 0, then P and Q can be taken to be real 
and equal, in which case ei, e 2 , and e3 are real with e 2 = e3. If /3 2 + 4a 3 < 0, 
then P and Q can be taken to be complex conjugates, in which case ei, e 2 , and 
e3 are real and distinct; in fact, they can be written 



ei 



e 2 := 



e3 := 



2(V^)cos(0/3) A - 
3(1 + k)(1 + A) ~ 3(1 + 
2(v^)cos((6» + 27r)/3) 

3(1 + k)(1 + A) 
2( % /^a)cos((6> + 4 7 r)/3) 

3(1 + «)(! + A) 



X—K, 

3(1 + k)' 

X—K 

3(1 + k)' 



where 9 := cos _1 (^/3/ V— a 3 ), which implies that 1 > ei > e3 > e 2 > — 1. See 
Figure 1. 

If we define the vector-valued function r : C i— > C 4 by 



r(x) 



/-A(l + « - A - A 2 ) - (1 + A)(l + k-X- X 2 )x + (1 + k)(1 + A) 2 a; 2 ^ 
(1 + k - A - A 2 ) - (1 + k)(1 + A) (A - k)x -(1 + k) 2 (1 + X)x 2 
-(l + K- A)(l - kX) + (1 + k)(1 - kX)x 
A(1-kA) 



V 



then 



r 



(1, 1, 1, 1) T , r 1 :=r(e 1 ), r 2 := r(e 2 ), r 3 := r(e 3 ), 



are corresponding right eigenvectors, and they are linearly independent if and 
only if the eigenvalues are distinct. If the eigenvalues arc distinct, we define 
R := (r ,r 1} r 2 ,r 3 ) and L := Br 1 . 
With 

u := - (1, 1, 1, 1) and C := 

we can use (28) to write 

M[r,a](0) = (r + s)- 1 ^, 

where 



2/(1 + k)-1 
2A/(1 + A)-1 
2A/(1 + A)-1 
V2[l-A/(l + «)]-iy 



r > 2, s > 1, 



(38) 



E s := uRD s LC 



3 Caution should be exercised when evaluating Q numerically. Specifically, if x < 0, Math- 
ematica returns a complex root for ^fx. If the real root is desired, one should enter — v / — x. 
This issue does not arise with P and can be avoided with Q by redefining Q := —a/ P. 
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1 2 3 4 5 

K 

Figure 1: The parameter space {(k, A) : k > 0, A>0, A<1 + k}, restricted 
to k < 5 and A < 5. In regions 1, 2, 3, and 6, (3 2 + 4ce 3 > (ei is real, e 2 and 
e3 are complex conjugates); in regions 4 and 5, (3 2 + 4a 3 < (ei, e 2 , and 
are real). If the conjecture stated below is correct, then, in regions 1, 3, and 4, 
^[r,s] (0) > for all r, s > 1; in regions 2, 5, and 6, /i[ riS ] (0) < for all r, s > 1. 

with 

. . / l-ef l-e| l-e§\ 

£> s := drag s, 1 -, ^ a . 

V 1-ei l-e 2 l-e 3 y 

Algebraic simplification leads to 

E s = c - c x e\ - c 2 62 - c 3 e3, (39) 

(1 + k)(A-k)(1 - A) 
4A(2 + k + A) 

c-2 ■= /(e 2 , e 3 , ei), c 3 := /(e 3 , e x , e 2 ), 

/(a:, y, z) := (A - k)[A(A -k)-(1 + k- A- A 2 )a; + (1 + k)(1 + A)a; 2 ] 

• [1 + 3n - 2A + 3k 2 - 4kA - A 2 + k 3 - 9kA 2 + 6A 3 + 2/* 3 A 



where 

co 

and 

ci := /(ei,e 2 ,e 3 ), 

with 
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- 7k 2 A 2 + 6kA 3 + k 3 A 2 - 2k 2 A 3 + 4kA 4 - 2A 5 

- (1 + «)(1 + A)(l + 2k - 3A + k 2 - 2kX + k 2 X - 2kA 2 
+ 2A 3 )(y + z) + (l + k) 2 (1 + A) 2 (l + n- 2\)yz] 

/[4(1 + K ) 3 A(1 + A) 2 (l - K A)(1 - x)(x -y)(x- z)]. 

It remains to consider 

M[i. s] (0) = (l + s)- 1 F s , s>l, (40) 

where 

F s : n s l RD s LC. 

Here ir Sy i is the stationary distribution of P^Pa- This is just a left eigenvector 
of 

Rdiag(l,el,e s 2 ,e s 3 )LP A 
corresponding to eigenvalue 1. Writing it = (ttq, fix, 7r 2 , tts) := ^s.ij we find that 

- = - = 1 + /o(ei, e 2 , e 3 )ef + / (e 2 , e 3 , eQef + J (e 3 , ei, e 2 )eg 
4 + /2(ei, e 2 , e 3 )ef + / 2 (e 2 , e 3 , ei)e| + / 2 (e 3 , d, e 2 )e| ' 

„ _ „ _ 1 + /i(ei,e 2 ,e 3 )ef + f 1 (e 2 ,e 3 ,e 1 )e s 2 + /i(e 3 , ei, e 2 )eg 
4 + / 2 (ei, e 2 , e 3 )ef + / 2 (e 2 , e 3 , ei)e| + / 2 (e 3 , ei, e 2 )e| ' 

where 

/o(as, y, z) := [1 + k - 2A - (1 + «)a?]fl(y, z)/[2(l + k) 2 A(1 + A)(x - y)(z - a)], 
fi(x,y,z) := [(1-A)(l + K-A-A 2 )-(1 + A)(l-K 2 + KA-A 2 )a; 
+ (1 + K )(l + A)(A- K )x 2 ] 5 (y,z) 
/[2(1 + k) 2 A(1 + A)(l - k\)(x - y){x - z)], 
f 2 (x, y, z) := [2 + 2k - 4A - 2kA - k 2 A + 2kA 2 + A 3 - (2 + k - k 2 + A 

- 2k 2 A - A 2 + kA 2 - A 3 )a; + (1 + k)(1 + A) (A - k)o; 2 M?/, z) 
/[(l + K ) 2 A(1 + A)(l - kA)(z - y)(z - z)], 

with 

g(y, z) := f + 2k - 3A + k 2 - 2kX + k 2 X - 2k\ 2 + 2A 3 

- (1 + k)(1 + A)(l + k - 2A)(y + z) + (1 + k) 2 (1 + A)yz. 

Letting v := (1/4)(1, 1, — 1, —1), we can write 

it = u + (it — u) = u + (Atcq — l)v, 

so F s = E s + G S H S , where 

G s := 4tt - 1 = 2(7r - tt 2 ) 
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= 2 (/o - /i)(ei,e 2 ,e 3 )ef + (Jo - fi)(e 2 ,e 3 ,e 1 )e s 2 + (/ - f 1 )(e 3 ,e 1 ,e 2 )e s 3 
4 + h{e\,e2, e 3 )ef + /2(e 2 , e 3 , ei)e| + / 2 (e 3 , ei, e 2 )e| 

and 

H s := vRD 8 LC,. 

The argument that gave us (39) yields 

H s =b - bie{ - b 2 e s 2 - b 3 e s 3 , 

where 

1 + k - 2X - A 2 + k\ 2 
b ° : 4A(1 + A) ' 

and 

b x := /i(ei,e 2 ,e 3 ), b 2 := h(e 2 , e 3 , ei), 6 3 := /i(e 3 , ei, e 2 ), 

with 

h(x, y, z) := [2 + 2k - 4A - 2kA - k 2 A + 2kA 2 + A 3 - (2 + k + A - k 2 - A 2 

- 2k 2 A + kA 2 - A 3 )x + (1 + k)(1 + A)(A - k)x 2 ][1 + 3k - 2A 
+ 3k 2 - 4kA - A 2 + k 3 - 9kA 2 + 6A 3 + 2k 3 A - 7k 2 A 2 + 6kA 3 
+ k 3 A 2 - 2k 2 A 3 + 4kA 4 - 2A 5 - (1 + k)(1 + A)(l + 2k - 3A 
+ k 2 - 2n\ + k 2 X - 2k\ 2 + 2\ 3 ){y + z) 
+ (l + K) 2 (l + A) 2 (l + K-2A)yz] 
/[4(1 + k) 3 A(1 + A) 2 (l - k\){1 - x)(x - y){x - z)]. 

Thus, (38) and (40) provide explicit, albeit complicated, formulas for ^ r s ^(0) 
for all r, s > 1. They are valid provided only that (3 2 + 4a 3 ^ (ensuring that 
Pb has distinct eigenvalues) and k\ ^ 1 (ensuring that the denominators of the 
formulas are nonzero). 

We can extend the formulas to k\ = 1 by noting that, in this case, is 
an eigenvalue of Pb and the two remaining nonunit eigenvalues, which can be 
obtained from the quadratic formula, are distinct from and 1 unless k = A = 1. 
Here we are using the assumption that A < 1 + k, hence k > (— 1 + V5)/2. This 
allows a spectral representation in such cases and again leads to formulas for 
M[r,s](0) for all r, s > 1, which we do not include here. Writing the numerator of 
f(x, y, z) temporarily as (A— n)p(x)q(y, z), notice that the two nonunit, nonzero 
eigenvalues coincide, when k\ = 1, with the roots of p(x), and this ordered pair 
of eigenvalues is also a zero of q. This explains why the singularity on the curve 
k\ = 1 is removable. 

We cannot prove the analogue of Theorem 7 in this setting, so we state it as 
a conjecture. 

Conjecture. Let games A and B be as in Theorem 4 (with the bias parameter 
absent). For every pair of positive integers r and s, /i[ rjS ](0) > i/ k < A < 1 
or k > X > 1, /i[ r s ](0) = if k = A or A = 1, and m riS ](0) < if X < min(K, 1) 
or X > max(K, 1). 
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Corollary 9. Assume that the conjecture is true for some pair (k, A) satisfying 
< k < A < 1 or K > X > 1 . Let games A and B be as in Corollary 5 ( with the 
bias parameter present) . For every pair of positive integers r and s, there exists 
Eq > 0, depending on k, X, r, and s, such that Parrondo's paradox holds for 
games A, B, and pattern [r,s\, that is, Ha{s) < 0, < 0, and /ir r s i(e) > 0, 

whenever < e < Eq- 

We can prove a very small part of the conjecture. Let K be the set of 
positive fractions with one-digit numerators and denominators, that is, K := 
{k/l : k, I = 1, 2, . . . , 9}, and note that K has 55 distinct elements. 

Theorem 10. The conjecture is true if (a) K = X > 0, (b) k > and X = 1. 
or (c) k, X e K, X < 1 + k, k ^ X, X ^ 1, (3 2 + Aa 3 ^ 0, and kX ^ 1. 

Remark. Parts (a) and (b) are the fair cases. Part (c) treats 2123 unfair cases 
(702 winning, 1421 losing), including the case n — 1/9 and A = 1/3 studied by 
Parrondo, Harmer, and Abbott (2000). (The assumption that 1 + 4a 3 ^ is 
redundant.) The proof of part (c) is computer assisted. 

Proof. We begin with case (a), K = A > 0. In this case Co = cj = c-2 = C3 = 0, 
hence E s = 0, while 

(/o - fi)(x,y,z) 

(A - k)[X(X -k)-(1 + k-X- X 2 )x + (1 + k)(1 + X)x 2 ]g{y, z) 
2(1 + k) 2 A(1 + A)(l - K \)(x - y)(x - z) ' 

hence G s = 0. We conclude that jUr r)S i(0) = for all r, s > 1 in this case. The 
argument fails only when k = A = 1 because, assuming that k = A, only then is 
f3 2 + 4q 3 = or is kX = 1. But in that case game B is indistinguishable from 
game A, so again £t[ r . s ](0) = /m(0) = for all r, s > 1. 

Next we consider case (b), A = 1 and either < k < 1 or k > 1. We write 
the numerator of f(x,y,z) temporarily as (1 — n)p(x)q(y, z). Each nonunit 
eigenvalue of Pb is a root of the cubic equation x 3 + a2X 2 + a%x + oq = with 
coefficients (37). With A = 1, this equation, multiplied by 4(1 + n) 2 , becomes 

= 4(1 + k) 2 x 3 + 4(1 + «)(1 - k)x 2 + (3 + k)(1 - k)x + (1 - n) 2 
= [2(1 + k)x 2 + (1 - k)x + 1 - «][2(1 + k)x + 1-k] 
= p(x)[2(l + k)x + 1 - k]. 

Moreover, we have (3 2 + Aa 3 = 108(1 + k) 2 (1 - k) 3 (7 + 9k). If n < 1, then 
/3 2 +4a 3 > (the eigenvalues are distinct with e2 and ez complex conjugates). In 
this case, p has complex roots, sopfa) = p{ez) = and e\ = — (1 — k)/[2(1 + k)]; 
in addition, e2 and e^, being roots of p, have sum — (1 — k)/[2(1 + k)] and product 
(1 — k)/[2(1 + k)], hence g(e2,ea) = 0. Therefore, c = c\ = c 2 = c 3 = and 
i^s = 0. Finally, (/o — fi)(x,y,z) has as a factor and 5(62,63) = 0, hence 
G s = 0. On the other hand, if k > 1, then /3 2 + 4a 3 < (the eigenvalues are 
real and distinct). In this case, two of the three eigenvalues e\, e 2 , and 63 are 
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roots of p, so the argument just given in the case n < 1 applies in this case as 
well with the two mentioned eigenvalues replacing ei and e^. 

We turn to case (c), but let us begin by treating the general case. Given 
K > and A > with A < 1 + k, k 7^ A, and A 7^ 1, we clearly have cq ^ 0. The 
conjecture says that E s and F s := E s + G S H S have the same sign as cq for all 
s > 1. 

We assume in addition that 1 + 4a 3 =^ and kX ^ 1. If /3 2 + 4a 3 > 0, then 
we can take e\ real and e 2 and e% complex conjugates. It follows that c\ is real 
and C2 and C3 are complex conjugates. Similarly, b\ is real and 62 and 63 are 
complex conjugates. Therefore, 

E s = c - cief - c 2 e2 - 0363 = c - Cief - 2 Re(c2e|), 
ff s = b - bie{ - b 2 e s 2 - b^l = b - b x e\ - 2 Rc^ea). 

If 1 + 4a 3 < 0, then ei, e 2 , and e 3 are real and distinct, as we have seen, and 
therefore ci, C2, C3, 61, b%, 63 are real. In either case, E s has the same sign as Co 
if 

|co|-{|c 1 ||e 1 r + |c2||e2r + |c3||e 3 r} (41) 

is positive. Notice that (41) increases in s and is positive for s large enough. 
Given (k, A) with cq 7^ 0, 1 + Aa 3 ^ 0, and kA ^ 1, there exists sq > 1, 
depending on (k, A), such that (41) is positive for all s > sq. It is then enough to 
verify by direct computation that E s has the same sign as Co for s = 1, 2, . . . , sq— 
1. In fact, we believe, but cannot prove, that so is never larger than 3. If true, 
this would imply that the conjecture holds for r > 2 and s > 1. (We are using 
the observations that /zr r , s i(0) is continuous in (k, A) and that the set of (/c, A) 
such that P 2 + 4a 3 7^ and kA 7^ 1 is dense. We are also implicitly using the 
fact, not yet proved, that /^[ r . s ](0) 7^ on the curves (3 2 + 4a 3 = and nX = 1, 
except at ac = A = 1.) 

The case r = 1 is more complicated. Observe that F s has the same sign as 
c if 

|co|-||ci||ei| s + |c2||e2r + |c3||e 3 r 

2 \fo ~ /i|(ei,e 2 ,e 3 )|ei| s + \f - /i|(e 2 , e 3 , ei)|e 2 | s + \fo - /i|(e 3 , e lt e 2 )|e 3 | s 
4 - |/ 2 |(ei, e 2 , e 3 )|ei| s - |/ 2 |(e 2 , e 3 , ei)|e 2 | s - |/ 2 |(e 3 , ei, e 2 )|e 3 | s 

■(|6o| + |6i||ei| s + |62||e 2 | s + |&3||e3| s )J (42) 

is positive, a stronger condition than requiring that (41) be positive. Notice 
that (42) increases in s and is positive for s large enough. Given (k, A), again 
with Co 7^ 0, P 2 + 4a 3 7^ 0, and acA 7^ 1, there exists s± > 1, depending on 
(ac, A), such that (42) holds for all s > s±. It is then enough to verify by direct 
computation that F s has the same sign as Co for s = 1, 2, . . . , s\ — 1. It appears 
that si can be quite large. 

We have carried out the required estimates in Mathematica for the 2123 
cases of part (c). There were no exceptions to the conjecture. Table 1 lists a 
few of these cases. □ 
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Table 1: A few of the 2123 cases treated by Theorem 10(c). so is the smallest 
positive integer s that makes (41) positive, si is the smallest positive integer s 
that makes (42) positive. 



(k,A) 


region 


(P0,Pl,P3) 


so 






of Fig. 1 








(1/9,1/3) 


1 


(9/10,1/4,7/10) 


1 


2 


(1/3,1/9) 


G 


(3/4,1/10,11/12) 


1 


6 


(9,3) 


3 


(1/10,3/4,7/10) 


1 


3 


(1/9,1/8) 


1 


(9/10,1/9,71/80) 


1 


(i 


(1/9,8/9) 


1 


(9/10,8/17,1/5) 


2 


3 


(8,1/9) 


6 


(1/9,1/10,80/81) 


1 


27 


(4,9/2) 


2 


(1/5,9/11,1/10) 


1 


3 


(3,3/2) 


4 


(1/4,3/5,5/8) 


1 


1 


(3,2/3) 


5 


(1/4,2/5,5/6) 


1 


2 



Here are four of the simplest cases: 

(A-«0(1-A) 
^ (e)= 2(2 + w + A)(l + A) +Q(e) ' 

(A - - A)(« + A + 2kA)(2 + 2k + kA - A 2 ) 
M[i,2] {£) - 3(1 + + A )( 2 + K + A)( K + 3A + 4kA + kA 2 - A 3 ) + [£) 

(A- k)(1 - A) _ , 

"'-■' (e)= 2(ri 1)(1 ;.)(! + A) +0(£) - 



(A-«)(1-A)(1 + 2k-A) 
2(r + 2)(l + «) 2 (l + A) 

Notice that the final factor in the numerator and the final factor in the de- 
nominator of ^[1,2] (0) are both positive. (Consider two cases, A < K and 
k < X < 1 + k.) The same is true of /ziy 2 ](0), r > 2. 

We turn finally to the evaluation of the asymptotic variance per game played 
of the player's cumulative profit. We denote this variance by crf rs j{s), and wc 
note that it suffices to assume that e = in the calculation to obtain the formula 
up to O(e). 

A formula for a? r s j (0) analogous to (38) and (40) would be extremely com- 
plicated. Wc therefore consider the matrix formulas of Section 5 to be in final 
form. 

For example, we have 

ofx.i] ( £ ) = (16 + 32k + 48A + 18k 2 + 124kA + 18A 2 + k 3 + 91k 2 X + 71kA 2 

- 3A 3 + 22k 3 A + 28k 2 A 2 + 38kA 3 - 8A 4 + k 3 A 2 + 15k 2 A 3 

- kA 4 + A 5 )/[2(l + A) 2 (2 + k + A) 3 ] + O(e), 
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2 , , (A-k)(8 + 7k + 17A+18kA + 6A 2 + 7kA 2 + A 3 ) 

= 1 - K - >- 4(r + 1)(1 + K)a(1 + A)a " + 

a f r .2] (e) = 1 + (8 + 36k - 20A + 71k 2 - 42kA - 37A 2 + 64k 3 + 24k 2 A 

- 120kA 2 + 20k 4 + 96k 3 A - 118k 2 A 2 - 12kA 3 + 6A 4 
+ 48k 4 A - 16k 3 A 2 - 24k 2 A 3 + 4kA 4 + 4A 5 + 20k 4 A 2 

- 16k 3 A 3 - fc 2 A 4 + 6kA 5 - A 6 )/[4(r + 2)(1 + k) 4 (1 + A) 2 ] 
+ 0(e), 

for r > 2. The formula for ah 2 ,(e) is omitted above; ct^ 2 ](0) is the ratio of two 
polynomials in k and A of degree 16, the numerator having 110 terms. 

When k = 1/9 and A = 1/3, the mean and variance formulas simplify to 

/ s 1 r^, x o / \ 8945 n . , 

M[M](£) = 44 + 0(e), af 1A] (e) = — + 0(e), 

. , 203 ^, . 2 . . 1003207373 ^, . 

"M (e) = 16500 +0(£) ' = 998250000 + 

1 1039 
M[2,i](e) - gQ +0(e), af 2tl] (e) =_ + 0(e), 

1 2 / N 19617 ^/ \ 

^ 2 1 (£)= 100 +O(e) ' ^ 2 1 (£)= 20000 + 0{£) - 

8 Why does Parrondo's paradox hold? 

Several authors (e.g., Ekhad and Zeilberger 2000, Rahmann 2002, Philips and 
Fcldman 2004) have questioned whether Parrondo's paradox should be called a 
paradox. Ultimately, this depends on one's definition of the word "paradox," 
but conventional usage (e.g., the St. Petersburg paradox, Bcrtrand's paradox, 
Simpson's paradox, and the waiting-time paradox) requires not that it be un- 
explainable, only that it be surprising or counterintuitive. Parrondo's paradox 
would seem to meet this criterion. 

A more important issue, addressed by various authors, is, Why does Par- 
rondo's paradox hold? Here we should distinguish between the random mixture 
version and the nonrandom pattern version of the paradox. The former is easy to 
understand, based on an observation of Moraal (2000), subsequently elaborated 
by Costa, Fackrcll, and Taylor (2005). See also Behrends (2002). Consider the 
capital-dependent games first. The mapping f(p) := (p 2 /(l + p 2 ), 1/(1 + p)) = 
(po,Pi) from (0, oo ) into the unit square (0, 1) x (0, 1) defines a curve represent- 
ing the fair games, with the losing games below and the winning games above. 
The interior of the line segment from f(l) — (|, |) to f(p) lies in the winning 
region if p < 1 (i.e., po < \) and in the losing region if p > 1 (i.e., po > |), 
as can be seen by plotting the curve (as in, e.g., Harmer and Abbott 2002). 
These line segments correspond to the random mixtures of game A and game 
B. Actually, it is not necessary to plot the curve. Using (16), we note that 
the curve defined by / is simply the graph of g(po) := 1/(1 + y/po/(l — po) ) 
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(0 < po < 1), and by calculating g" we can check that g is strictly convex on 
(0, |] and strictly concave on [|, 1). 

The same kind of reasoning applies to the history-dependent games, except 
that now the mapping /(k, A) := (1/(1+k), A/ (1+A), 1 — A/ (1 + k)) = (po,Pi,P3) 
from {(k, A) : k > 0, A > 0, A < 1 + k} into the unit cube (0, 1) x (0, 1) x (0, 1) 
defines a surface representing the fair games, with the losing games below and 
the winning games above. The interior of the line segment from /(1,1) = 
(|, |, |) to /(/t, A) lies in the winning region if k < A < 1 (i.e., po + pi > 1 and 
Pi < i) or k > A > 1 (i.e., po + Pi < 1 and pi > |). It is possible but difficult 
to see this by plotting the surface on a computer screen using 3D graphics. 
Instead, we note using (20) that the surface defined by / is simply the graph of 
g(po,Pi) ■= 1 -PoPi/(1 -Px) (0 <Po < 1, < pi < 1, p Pi < 1 ~Pi)- So with 
fo(t) : = ff ((l - t)/2 + tp , (1 - t)/2 + tpi) for < t < 1, we compute 

.,//,x _ 4(po+pi -l)(2pi -1) 
( j ~ [1 - (2px - l)i] 3 

and observe that h"(t) > for < t < 1 if and only if both po + Pi > 1 and 
pi < i, or both po +pi < 1 and pi > |. In other words, g restricted to the line 
segment from (5,5) to (po,Pi) is strictly convex under these conditions. This 
confirms the stated assertion. 

The explanations for the nonrandom pattern version of the paradox are less 
satisfactory. Ekhad and Zeilberger (2000) argued that it is because "matrices 
(usually) do not commute." The "Boston interpretation" of H. Eugene Stan- 
ley's group at Boston University claims that it is due to noise. As Kay and 
Johnson (2003) put it, "losing cycles in game B arc effectively broken up by the 
memoryless behavior, or 'noise', of game A." Let us look at this in more detail. 

We borrow some assumptions and notation from the end of Section 5. As- 
sume that e = 0. Denote by P' A the matrix with [i, j)th entry (PA)ijw(i,j), 
and assume that P' A has row sums equal to 0. Denote by P' B the matrix with 
(i,j)th entry (PB)ijw(i,j), and define £ := P' B {1, 1, . . . , 1) T to be the vector 
of row sums of P' B . Let tvb be the unique stationary distribution of Pb, and 
let 7c St r be the unique stationary distribution of P B P A . Then the asymptotic 
mean per game played of the player's cumulative profit for the pattern [r, s] 
when e = is 

fi [r ,.](0) = (r + s)- 1 7 rs . r (/ + P B + --- + P B T 1 )C. 

If it were the case that 7r s r = ttb, then we would have 

M[r,*](0) = (r + sy 1 sn B C = 0, 

and the Parrondo effect would not appear. If we attribute the fact that 7r s r 
is not equal to 7zb to the "noise" caused by game A, then we can justify the 
Boston interpretation. 

The reason this explanation is less satisfactory is that it gives no clue as 
to the sign of m riS i(0), which indicates whether the pattern [r, s] is winning or 



35 



losing. We propose an alternative explanation (the Utah interpretation?) that 
tends to support the Boston interpretation. To motivate it, we observe that 
(r + s)/ir riS ](0) can be interpreted as the asymptotic mean per cycle of r plays of 
game A and s plays of game B of the player's cumulative profit when e = 0. If s 
is large relative to r, then the r plays of game A might reasonably be interpreted 
as periodic noise in an otherwise uninterrupted sequence of plays of game B. 
We will show that 

lim (r + sW r s] (0) 

s— >oo 

exists and is finite for every r > 1. If the limit is positive for some r > 1, then 
A*[r,s] (0) > for that r and all s sufficiently large. If the limit is negative for 
some r > 1, then /i[ r jS ](0) < for that r and all s sufficiently large. These 
conclusions are weaker than those of Theorem 7 and the conjecture but the 
derivation is much simpler, depending only on the fundamental matrix of Pb, 
not on its spectral representation. 

Here is the derivation. First, 7T Sir = iPJ, where tt is the unique stationary 
distribution of P r A P B . Now 

lim P\P S B = p^n B = U B , 

s — >oo 

where lis is the square matrix each of whose rows is ttb- We conclude that 
7r s r — > ttbPa as s ~~ * 00 an( l therefore that 

lim (r + s)m r s i(0) = lim 7r s , r (J + P B + ■ ■ ■ + P^K 

s — >oo s — ^oo 



= 7TB Pa 1™ 



Y,{Pb -U B ) + sTl B 
C 



n=0 



= 7v B p r A J2( p s- u b) 

- n=0 

= 7v B P^(Z B -U B )C 
= 7v B P r A Z B C, r > 1, 

where Zb denotes the fundamental matrix of Pb (see (7)). Since ttbZb = t^b 
and ttbC = 0, it is the P T A factor, or the "noise" caused by game A, that leads 
to a (typically) nonzero limit. 

In the capital-dependent setting we can evaluate this limit as 



lim (r + s)/X[ r>s ](0) 



3a r (l-p) 3 (l + p) 



r > 1, 



2(l + p + p 2 ) 2 ' 

where a r is as in (31), while in the history-dependent setting it becomes 

(1 + k)(X — k)(1 — A) 



lim (r + 8)n[r tS ](0) 



4A(2 + « + A) 



r > 1. 



Of course we could derive these limits from the formulas in Sections 6 and 7, but 
the point is that they do not require the spectral representation of Pb — they 
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are simpler than that. They also explain why the conditions on p are the same 
in Theorems 2 and 7, and the conditions on n and A are the same in Theorem 
4 and the conjecture. 



Acknowledgments 

The research for this paper was carried out during J. Lee's visit to the Depart- 
ment of Mathematics at the University of Utah in 2008-2009. The authors are 
grateful to the referees for valuable suggestions. 

References 

Abbott, Derek (2009) Developments in Parrondo's paradox. In: In. V., 
Longhini. P., and Palacios, A. (eds.) Applications of Nonlinear Dynamics: 
Model and Design of Complex Systems. Series: Understanding Complex Sys- 
tems. Springer- Verlag, Berlin, 307-321. 

Ajdari, A. and PROST, J. (1992) Drift induced by a spatially periodic poten- 
tial of low symmetry: Pulsed dielectrophoresis. Comptes Rendus de I'Academie 
des Sciences, Serie 2 315 (13) 1635-1639. 

Behrends, Ehrhard (2002) Parrondo's paradox: A 
priori and adaptive strategies. Preprint A-02-09. 

ftp : //ftp .math. f u-berlin. de/pub/math/publ/pre/2002/index .html 

Berresford, Geoffrey C. and Rockett, Andrew M. (2003) Parrondo's para- 
dox. Int. J. Math. Math. Sci. 2003 (62) 3957-3962. MR2036089 (2004j:91068). 

Billingsley, Patrick (1995) Probability and Measure, third edition. John Wi- 
ley & Sons Inc., New York. MR1324786 (95k:60001). 

Bradley, Richard C. (2007) Introduction to Strong Mixing Conditions, Vol- 
ume 1. Kendrick Press, Hebcr City, UT. MR2325294 (2009f :60002a). 

Cleuren, B. and Van DEN Broeck, C. (2004) Primary Parrondo paradox. 
Europhys. Lett. 67 (2) 151-157. 

COSTA, Andre, Fackrell, Mark, and Taylor, Peter G. (2005) Two issues 
surrounding Parrondo's paradox. In: Nowak, A. S. and Szajowski, K. (eds.) 
Advances in Dynamic Games: Applications to Economics, Finance, Optimiza- 
tion, and Stochastic Control, Annals of the International Society of Dynamic 
Games 7, Birkhauser, Boston, 599-609. MR2104716 (2005h:91066). 

DuRRETT, Richard (1996) Probability: Theory and Examples, second edition. 
Duxbury Press, Belmont, CA. MR1609153 (98m:60001). 



37 



Ekhad, Shalosh B. and Zeilberger, Doron (2000) Remarks on the Parrondo 
paradox. The Personal Journal of Shalosh B. Ekhad and Doron Zeilberger. 
http: //www. math. rutgers . edu/~zeilberg/pj .html 

Epstein, Richard A. (2007) Parrondo's principle: An overview. In: Ethier, S. 
N. and Eadington, W. R. (eds.) Optimal Play: Mathematical Studies of Games 
and Gambling. Institute for the Study of Gambling and Commercial Gaming. 
University of Nevada, Reno, 471-492. 

Harmer, Gregory P. and Abbott, Derek (2002) A review of Parrondo's para- 
dox. Fluct. Noise Lett. 2 (2) R71-R107. 

Kay, Roland J. and JOHNSON, Neil F. (2003) Winning combinations of history- 
dependent games. Phys. Rev. E 67 (5) 056128. arXiv:cond-mat/0207386. 

Kemeny, John G. and Snell, J. Laurie (1960) Finite Markov Chains. D. Van 
Nostrand Company, Inc., Princeton, NJ. MR0115196 (22 #5998). 

Key, Eric S., Klosek, Malgorzata M., and Abbott, Derek (2006) On Par- 
rondo's paradox: How to construct unfair games by composing fair games. 
ANZIAM J. 47 (4) 495-511. MR2234017. arXiv:math/0206151. 

Moraal, Hendrik (2000) Counterintuitive behaviour in games based on spin 
models. J. Phys. A: Math. Gen. 33 L203-L206. MR1778614 (2001d:91049). 

Parrondo, Juan M. R. (1996) Efficiency of Brownian motors. Presented at 
the Workshop of the EEC HC&M Network on Complexity and Chaos, Institute 
for Scientific Interchange Foundation, Torino, Italy. 

Parrondo, Juan M. R., Harmer, Gregory P., and Abbott, Derek (2000) 
New paradoxical games based on Brownian ratchets. Phys. Rev. Lett. 85 (24) 
5226-5229. arXiv:cond-mat/0003386. 

Parrondo, J. M. R. and Dini's, Luis (2004) Brownian motion and gambling: 
From ratchets to paradoxical games. Contemp. Phys. 45 (2) 147-157. 

PERCUS, Ora E. and Percus, Jerome K. (2002) Can two wrongs make a right? 
Coin-tossing games and Parrondo's paradox. Math. Intelligencer 24 (3) 68-72. 
MR1927042 (2003f:91025). 

Philips, Thomas K. and Feldman, Andrew B. (2004) Parrondo's 
paradox is not paradoxical. Social Sciences Research Network. 
http: //ssrn. com/abstract=581521 

Pyke, Ronald (2003) On random walks and diffusions related to Parrondo's 
games. In: Moore, M., Froda, S., and Lcger, C. (eds.) Mathematical Statistics 
and Applications: Festschrift for Constance Van Eeden. Institute of Mathemat- 
ical Statistics, Lecture Notes-Monograph Series 42, Beachwood, OH, 185-216. 
MR2138293 (2006e:60062). arXiv:math/0206150. 



38 



Rahmann, Sven (2002) Optimal adaptive strate- 

gies for games of the Parrondo type. Preprint, 
http : //gi . cebitec . uni-bielef eld. de/people/rahmann/parrondo/raJimann-report .pdf 



39 



